Transferring Objects within an Ongoing File Transfer Operation 



Field of Invention 

The present invention relates generally to content delivery to wireless devices and, more 
particularly, to sending binary objects such as pictures within a non-related file transfer 
operation. 

Background of the Invention 

In the information age of today, computing devices have proliferated virtually 
throughout all levels of modem society. These devices often interact with each other and 
with computers through networks such as local area networks (LANs) generally by 
means of wires or cables. Other means of connectivity have been developed, for 
example, to provide links between PCs and peripherals using infrared connections based 
on the IrDA protocol developed by the Infrared Data Association. Infrared connections 
provide interoperable communication between devices through standard IrDA ports that 
are included in many devices, such as desktop and laptop computers, printers, fax 
machines, keyboards, joysticks and other digital devices. 

Despite the advantages provided by infrared connections, there are some notable 
limitations to its practical use. For example, infrared connections typically require a 
rel^ively short line-of-sight connection and is very directional. Furthermore, infrared 
beams can not penetrate opaque materials such as walls thereby limiting its use within 
the same room. The growing prevalence of wireless handheld devices such as mobile 
phones and PDAs has created a need to provide connectivity by enabling voice and data 
connections with computers and other digital devices. 

One proposed solution that provides the desired connectivity without the limitations 
imposed by infrared is Bluetooth. Bluetooth is a communications standard for short- 
range radio connections that allow communication with mobile devices in an ad-hoc 



fashion. Bluetooth enables voice and data transfer between communication devices and 
computing devices within a range of about 10 to 100 meters. Since it is based on radio 
technology, it allows for the elimination of cables that normally connect devices to be 
replaced by a universal short-range radio link. And due to its RF nature, the devices do 
not need to be within line-of-sight of each other which allow connections through walls 
or other non-metal objects. This enables mobile phones to be especially suitable for use 
with Bluetooth where they could, for example, operate as a modem for a laptop or PDA 
to further enhance mobility. 

Some appUcations that are suitable for use with Bluetooth include synchronization of 
calendars, messaging, and phonebooks, file transfer functionality, and object push for 
business card support, for example. The Bluetooth specification defines the use of the 
Object Exchange (OBEX) protocol for transferring objects such as files, pictures, 
calendar entries (vCalendar) and business cards (vCard). OBEX is a session protocol 
that was originally specified by the IrDA (Infrared Data Association) for transporting 
objects over infrared connections. For a more complete description of the OBEX 
protocol the interested reader may refer to "IrDA Object Exchange Protocol IrOBEX", 
version 1.2, Counterpoint Systems Foundry, Inc., March 18, 1999. 

Although OBEX provides an efficient method to transfer a wide variety of data and 
commands in a resource sensitive and standardized environment, typical OBEX 
transfers involve transporting one object (file) at a time. By way of example, using a 
PUT' command to initiate a file transfer operation precludes the use of sending other 
objects that are not part of the ongoing transfer. The PUT' command "pushes" content 
from a content storage of a sending device to a receiving device. However, there are 
times when it would advantageous to be able to send multiple unrelated objects during 
the same operation. 

Solutions presented in the past to deal with this issue have been intimately Unked with a 
specific protocol. By way of example, some systems use protocols that allow for 
multiplexing in the form of multiple sessions running in parallel. While others adopt 
different protocols for different types of content and run those protocols in parallel. 
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which would require more resources and processing power. With respect to using 
OBEX, the only solution thus far has been to open two separate sessions, by sending a 
connection request to two separate target IDs, and run them in parallel where each piece 
of content is handled as one object carried in one session. This technique has the 
5 drawback of requiring a relatively complex OBEX implementation which has a negative 
impact on performance of a low bit rate short range systems such as Bluetooth. 

In view of the foregoing, a technique is needed that permits the parallel transfer of 
multiple objects during an ongoing operation that is compatible with the OBEX protocol 
and does not require additional resources for a separate session. 

10 Summary of the Invention 

Briefly described and in accordance with an embodiment and related features of the 
-Zi invention, in a method aspect of the invention there is provided a method of transmitting 

objects during an ongoing packet transfer operation between a sending device and a 
^ receiving device, wherein said packet transfer is comprised of a plurality of packets 

" » 15 defined in accordance with a transfer protocol, the method comprises the step of 
2 transmitting the object with the packets associated with said packet transfer between the 
^ sending device and the receiving device. 

In a system aspect of the invention there is provided a system for sending a object 
during a file tiransfer operation, wherein tiie object data is embedded in a plurality of 
20 packets with said file transfer, the system comprises: 

a sending device for sending the object data; 

a receiving device for receiving object data from the sending device; 



means for embedding said object data in said plurality of packets; and 
means for displaying said object on said receiving device. 



The invention, together with further objectives and advantages thereof, may best be 
understood by reference to the following description taken in conjunction with the 
accompanying drawings in which: 

Figure 1 shows the structure of an OBEX packet; 

Figure 2 illustrates the structure of an exemplary name header; 

Figure 3 illustrates the structure of an exemplary length header; 

Figure 4 shows a configuration of tag-length-value triplets encoded in an AP 
header; 

Figure 5 illustrates an exemplary configuration of triplets for sending a series of 
two independent pictures, in accordance with an embodiment of the invention; 

Figure 6 illustrates an exemplary triplet configuration for sending a series of three 
pictures that fit into a single header, in accordance with an embodiment of the invention; 
and 

Figure 7 illustrates a triplet configuration for a three picture series that do not fit 
into a single header, in accordance with an embodiment of the invention. 

Detailed Description of the Invention 

As discussed in the preceding sections, the present invention discloses a technique to 
send objects (images) during a download operation using the Object Exchange (OBEX) 
protocol. Due to the bandwidth constraints in the wireless environment and the limited 
data rates available for use with short range communications, e.g. Bluetooth technology, 
downloading times can turn out to be relatively long. The method allows the transfer of 
multiple pieces of data, which are comparably smaller in size to an ongoing file transfer, 
in the same operation. 



The utility of this is demonstrated in an exemplary scenario where a user may be 
receiving a relatively large file which could take some time to complete and, in the 
meantime, the display of the receiving device will typically be blank while the device is 
occupied with the transfer. This "downtime" presents an opportunity to display graphical 
images on the receiving device to convey information. The displayed information could 
include advertisement content for use promoting products which could have the 
possibility of changing depending on the users location. 

which could introduce new revenue models for service providers. 

In an embodiment of the invention, the task of having two objects transferred in parallel 
is placed onto the upper layer i.e. the application that is making use of the OBEX 
operations. This is in contrast to having the OBEX implementation support parallel 
sessions. This becomes especially useful in situations where it is advantageous to keep 
the OBEX implementation to a minimum. Moreover, by mapping an existing image 
format onto an OBEX header and enriching it with display and timing information, the 
embodiment eliminates the need for having a separate control channel. 

OBEX is a session protocol that was originally specified by the IrDA (Infrared Data 
Association) for transporting objects over infrared connections. OBEX can be 
characterized as a binary equivalent to the HTTP protocol thus, because of its binary 
encoded nature, creates interesting possibilities for transporting binary (or textual) data 
such as pictures over links with limited bandwidth such as in Bluetooth. The protocol 
does not specify a top or bottom API thereby making it very flexible in that it can run 
over transport layers such as TCP/IP, in addition to Bluetooth baseband radio 
transmission channels. 

Figure 1 illustrates the general structure of an OBEX request packet. Each request 
packet comprises of an opcode in Byte 0 such as a PUT' (send content, opcode 0x02) or 
XjET' (retrieve content, opcode 0x03). In bytes 1 and 2 is a packet length in bytes and 
one or more headers from byte 3 and on. Examples of headers include name of file, 
length of file, and date which are typically followed by the object body (file data). A 
header must fit into a single request packet, although segments of data may be split over 



several packets, provided that, in each packet, the segment of data is preceded by a Body 
header. Furthermore, sending a large file may require many a PUT' packets to complete 
where the last packet will be signified by having the final bit set in the PUT' opcode (i.e. 
0x82). The PUT' command "pushes" content from a content storage of a sending device 
to a receiving device whereas a 'GET' command retrieves content from a device. 

Figure 2 illustrates the structure of an exemplary name header that may be sent within 
an OBEX request packet. For file transfers, the name header has a length of at least 3 
bytes (1 byte opcode + 2 byte length + variable length name). Although name headers 
are optional, they are recommended so that the receiving application knows what to do 
with the subsequent file content. In the example, the header opcode identifier is 0x01 
which indicates to the appUcation that this is a name header and a 2 byte length is 
0x0014 which gives the length of the following content. The content itself may be a text 
file, such as TRIAL.TXT as shown, where the receiving device such as a PC or PDA is 
able to interpret the contents of the name field as a filename. 

Figure 3 illustrates the structure of an exemplary length header. A length header 
identifier of X)xC3' is used to indicate the total length of the object to be transferred in 
the body header. The length, if known in advanced, is sent to the receiver before the 
content so that it may quickly terminate the transfer if it requires more space that it can 
handle. Moreover, the length information can be used in the calculation of the remaining 
transfer time for displaying a download indicator on the receiving device. The length 
header is optional since, in some cases, the length is not known in advance in which 
case the End-of-Body header is used to indicate when the end of the object is reached. 

In accordance with the invention, binary content image files are encapsulated into one or 
several OBEX Application Parameters headers, depending on the size of the picture 
data. The Apphcation Parameters header (AP header) is used by applications (and 
protocols) layered above OBEX to convey additional information in a request or 
response packet. In a request such as a PUT', the AP header conveys request parameters 
or modifiers. A Tag-Length- Value encoding scheme is used to support a variety of 
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request/response types or levels. An AP header may contain any number of tag-length- 
value triplets. 

Figure 4 shows a configuration of n number of tag-length-value triplets encoded in an 
AP header. The tag and length fields are each one byte each and are defined by the 
5 applications or upper protocol layer that uses them. The value field can include 
anywhere from zero to n bytes which contain the content of binary data. The number of 
triplets n is constrained by the size of the OBEX packet in which the AP is transported. 
The packet size is itself constrained by the maximum packet size negotiated during the 
establishment of the connection. In accordance with the invention, a binary image file, 
10 such as a JFIF formatted image, is encoded within a tag-length- value triplet of the main 
file transfer operation. A JFIF formatted image is a binary based format used to define 
the transmission of the widely used JPEG encoded bitmap data. It should be noted that 
the invention is not limited to JFEF formatted images but is applicable to other binary 
based encoded images such as JPG, JPG2000, GIF, PNG, TIF, EXIF, AVI, and MPS. 

15 The invention introduces parameters that are used to control the way the encoded image 
data is displayed on the receiving device. Individual pictures can be displayed 
independently or as multiple individual pictures displayed in succession which herein is 
referred to as a mini-clip series. Moreover, large image files may be segmented and 
spanned over several AP headers (triplets) of an ongoing file transfer. 

20 Figure 5 illustrates an exemplary configuration of triplets, in accordance with an 
embodiment of the invention, for sending a series of two independent pictures in 
headers 510 and 520 respectively. The content of the triplets include JFIF files, each of 
which are able to fit into a single header. Field 500 is a three byte tag comprising the 
SeriesSize parameter. The SeriesSize gives the size of the series that is about to be sent 

25 which is the sum of all the pictures in the series. This size is represented by 3 bytes and 
can take any value from 1 to 16777216 bytes. The parameter is also valid if the series 
only contains one picture. Typical sizes of individual pictures for display on a mobile 
device display are in the range of around 120x160 pixels (which represents about 3-9 
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Kbytes after JPG encoding), so for most applications a maximum of 16.7 M bytes is 
usually sufficient. 

Field 501 is a two byte field that indicates the PictureRefreshTime. The 
PictureRefreshTime determines the length of time in milliseconds the picture will be 
5 displayed. In the case as shown where there is only one independent picture, an OBEX 
parser can quickly determine that the AP header contains only one picture from the 
presence of PictureRefreshTime immediately following the Series Size parameter 500. 
Once the time elapses the receiving device could switch to another picture or series of 
pictures, or leave the last picture displayed or leave a blank screen when no other picture 
10 data is available. 

Field 502 is a PictureSize [2 bytes] parameter. The PictureSize indicates the total length 
of the picture data in bytes where its value ranges from 1 to 65536 bytes. This parameter 
is useful when the series contains multiple pictures to calculate the remaining picture 
data from the series size. 

15 Filed 503 is a Transfers tatus [I byte] parameter. The TransferStatus indicates whether 
the current triplet is carrying the last segment of a picture. The TransferStatus values are 
given by a code Hex where DxOl' indicates "More picture segments to come", X)x02' 
indicates "End of picture ", and X)x03' indicates "End of picture and of series Field 
504 contains the actual JFIF file picture data. 

20 Table 1 shows the tags that have been defined for use in the various tag-length-value 
triplets which encode to the following parameters: 



TAG 


PARAMETER 


0x01 


SeriesSize 


0x02 


SeriesRefreshNumber 
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0x03 


PictureRefreshTime 


0x04 


Pictures ize 


0x05 


TransferStatus 


0x06 


Imaging Data 



TABLE 1 



Figure 6 illustrates an exemplary triplet configuration, in accordance with an 
^ embodiment of the invention, for sending a series of three pictures, in which each are 
C3 small enough to fit into a single header. The series of individual pictures, when 

rii 

%i 5 displayed in succession, is also referred to as a mini-clip. As shown, parameters sent in 

^ the header of the first independent picture includes the SeriesSize [2 bytes], 

fij SeriesRefreshNumber [2 bytes], PictureSize [2 bytes], TransferStatus [1 byte], followed 

Lfe by the picture content. 

The SeriesSize, as mention earlier, gives die total size of all die pictures in the series 
O 10 whereas the SeriesRefreshNumber indicates the number of times the series containing 
all the pictures is displayed. After the last display of the series the receiving device 
could leave the last picture displayed, switch to another series of pictures, or leave the 
screen blank. The PictureSize indicates the size of the first independent picture of the 
series. The sum of the PictureSize fields of all the pictures in the series makes up the 
15 SeriesSize. The TransferStatus indicates whether the picture is the last picture in the 
series or if there are more to come. In this case it is not so the TransferStatus field in 610 
would contain the value of T)x02'. The fact that the header contains a SeriesSize 
parameter would indicate to the OBEX parser that the picture is the first one in the 
series. Following the TransferStatus is the picture data itself (JFIF file 1). 

20 The triplet 620 of the second independent picture in the series comprises the PictureSize 
that indicates the size of the picture, the PictureRefreshTime that indicates how long the 
picture is displayed e.g. in milliseconds (typically the first picture would be a title 
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picture in which an advance to the second picture could occur at the terminal's leisure), 
the TransferStatus (0x02") that indicates it is not the last in the series, and finally the 
picture data for JFIF file 2. 

The triplet 630 of the third independent picture in the series of three is the same as that 
5 for the second independent picture in 620 except that the TransferStatus field contains 
the value t)x03' to indicate the last picture in the series. 

The target device that receives these headers will display the pictures in succession to 
produce a mini-clip effect similar to the movement effect created by flashing still 
pictures. Since OBEX requires an underlying reliable transport layer, it can be assumed 
-J 10 that the pictures will be received and thus displayed in the correct order, although the 
first and last picture can always be deduced from the parameters. 

^ Figure 7 illustrates a triplet configuration, in accordance with an embodiment of the 

5°'-^ invention, for a three picture series where some of the pictures do not fit into a single 

header. The data for JFIF file 1 is too large to fit in header 712 and thus is segmented to 
r|| 15 span over a group of three headers represented by 710. The first picture group 710 
"pi comprises header 712, header 714, and header 716. In header 712, the parameter fields 
U comprise the SeriesSize [2 bytes] which gives the total size of the series and where its 

existence denotes the first picture of the series, the SeriesRefreshNumber [2 bytes] 
which gives the number of times the series is displayed, the PictureSize [2 bytes] which 
20 gives the size of the picture data for the combined headers, the TransferStatus [1 byte] 
which containing the value of T)x01' to indicate more pictures are to come. The final 
field of 712 contains the first segment of of JFIF file 1. This means that the picture is 
larger than the 64K maximum for the header which when spanned over three headers, 
implies that it is at least larger than 128K. Header 714 includes the TransferStatus value 
25 of X)x01' together with the second segment of JFIF file 1. The last header 716 of the 
group includes the third segment of JFIF file 1 together with a TransferStatus of X)x02' 
to indicates the last segment of the picture. 

The second picture of the series, JFIF file 2, is small enough to fit completely in header 
720. Thus, only the PictureSize, PictureRefireshTime, TransferStatus, and picture data 



are included in the header. The transfer status value of T)x02' indicates that it is the last 
(and only) picture of the group. 



The third picture of the series also spans over a group of three headers represented by 
730. A first header 732 comprises parameters that include a PictureSize, 
5 PictureRefreshTime, TransferStatus, followed by the first segment of the picture data. 
The transfer status field contains the value of DxOl' to indicate more picture data is to 
come. Header 734 includes the second segment of the third picture of the series. 
Likewise, the transfer status field contains the value DxOl' to signify that it is not the 
last segment of data. Header 736 includes a transfer status value of X)x03' which 
10 signifies the last segment and the end of the series. 

It should be noted that there is no limit to the number of headers over which the picture 
data can span. Thus the technique of spanning over multiple headers allows relatively 
large pictures to be displayed in mini-clip presentation. The invention also provides a 
degree of control over which pictures are displayed e.g. the length of time an individual 
1 5 picture is displayed and the frequency that the mini-clip is displayed. 

The format put forth by the invention is compatible for encapsulation within the OBEX 
protocol PUT' command for an ongoing file transfer. Thus, during a voluminous content 
transfer the user can receive embedded pictures having a predetermined display 
behavior. The lengthy transfer presents an opportunity to display graphical data on the 

20 receiving device, which would otherwise be blank. Although there is no explicit limit to 
the size or number of pictures, as a practical matter the picture content should be at least 
one order of magnitude smaller than the user content being downloaded so it does not 
significantly affect the main file transfer. Moreover, the invention, in addition to sending 
full size pictures, could send icons or small graphics data for superimposition on the 

25 current displayed information. 

It should be noted that the invention is not limited to use of Bluetooth but is applicable 
with any system that uses the OBEX protocol for data transfers such as infrared 
connections, for example. Beyond that, the objects (e.g. pictures) are not limited to the 
packet headers and can be transmitted in, for example, the data field of a packet transfer. 
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Furthermore, the transmission of pictures can be included in a packet transfer that 
includes non binary data by sending the pictures in packets that are combined with the 
packets of the packet transfer, thereby allowing the use of transport protocols other than 
OBEX. 

Although the invention has been described in some respects with reference to a specified 
embodiment thereof, variations and modifications will become apparent to those skilled 
in the art. It is therefore the intention that the following claims not be given a restrictive 
interpretation but should be viewed to encompass variations and modifications that are 
derived from the inventive subject matter disclosed. 



